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4.1.1 Probability Density Function (PDF) 

To determine the distribution of a discrete random variable we can either provide its PMF or CDF. For continuous random variables, the CDF 
is well-defined so we can provide the CDF. However, the PMF does not work for continuous random variables, because for a continuous 
random variable P(X = x) = 0 for all X E M. Instead, we can usually define the probability density function (PDF). The PDF is the 
density of probability rather than the probability mass. The concept is very similar to mass density in physics: its unit is probability per unit 
length. To get a feeling for PDF, consider a continuous random variable X and define the function fx (#) as follows (wherever the limit 
exists): 


fx(x) 


lim 

A—>0 + 


P(x < X < x + A) 

A 


The function fx (x) gives us the probability density at point X. It is the limit of the probability of the interval (,X\ X A] divided by the 
length of the interval as the length of the interval goes to 0. Remember that 

P(x < X < x + A) = F x {x + A) - F x {x). 


So, we conclude that 


fx{x) 


lim F x(x + ^)-Fx(x) 
A—>0 A 


dFxjx) 

dx 


= F^x), 


if F x (x) is differentiable at x. 


Thus, we have the following definition for the PDF of continuous random variables: 

Definition 4.2 

Consider a continuous random variable X with an absolutely continuous CDF Fx (#). The function fx (#) defined by 

fx(x) = I = Fx(x), if Fx{x) is differentiable at x 

is called the probability density function (PDF) of X. 


Let us find the PDF of the uniform random variable X discussed in Example 4.1 . This random variable is said to have Uniform^a, b ) 
distribution. The CDF of X is given in Equation 4.1. By taking the derivative, we obtain 


fx{x) 



a < x < b 
x < a or x > b 


Note that the CDF is not differentiable at points a and b. Nevertheless, as we will discuss later on, this is not important. Figure 4.2 shows the 
PDF of X. As we see, the value of the PDF is constant in the interval from a to b. That is why we say X is uniformly distributed over [a, b]. 


https://www.probabilitycourse.com/chapter4/4_1_1_pdf.php 


1/4 



9/8/2018 


Probability Density Function | PDF | Distributions 



The uniform distribution is the simplest continuous random variable you can imagine. For other types of continuous random variables the PDF 
is non-uniform. Note that for small values of S we can write 

P(x < X < x + S) ss fx{x)S. 

Thus, if fx (ail) > fx(x 2 ) , we can say P(x 1 < X < x\ + 5) > P(x 2 < X < X2 + 8), i.e., the value of X is more likely to 
be around X\ than X 2 ■ This is another way of interpreting the PDF. 


Since the PDF is the derivative of the CDF, the CDF can be obtained from PDF by integration (assuming absolute continuity): 


F x 



fx( u )du. 


Also, we have 


P(a<X<b) = F x (b)-F x (a) 



In particular, if we integrate over the entire real line, we must get 1, i.e., 



1 . 
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That is, the area under the PDF curve must be equal to one. We can see that this holds for the uniform distribution since the area under the 
curve in Figure 4.2 is one. Note that fx (#) is density of probability, so it must be larger than or equal to zero, but it can be larger than 1. Let 
us summarize the properties of the PDF. 


Consider a continuous random variable X with PDF fx (#). We have 

l.fx(x) > 0 for all X G R. 

2 fZ 0 fx(u)du = 1 . 

3. P{a < X < b) = F x {b) - F x (a) = / q 6 f x (u)du. 

4. More generally, for a set A, P(X G A ) = f A fxi u )du. 


In the last item above, the set A must satisfy some mild conditions which are almost always satisfied in practice. An example of set A could 
be a union of some disjoint intervals. For example, if you want to find P(X G [0,1] U [3, 4] ), you can write 


P(X 6 [0,1] U [3,4]) = f f x (u)du+ f f x (u)du. 

Jo J 3 


Let us look at an example to practice the above concepts. 


Example 4.2 

Let X be a continuous random variable with the following PDF 

x > 0 

otherwise 


fx(x) 


ce 

0 


where C is a positive constant. 


a. Find C. 

b. Find the CDF ofX, Fx{x). 

c. Find.P(l < X < 3). 


Solution 


a. To find C, we can use Property 2 above, in particular 

1 = IZcfxMdu 
= J 0 °° ce~ u du 


— c 

= c. 


Thus, we must have C = 1 . 

b. To find the CDF of X, we use F x ( X ) = f* f X ( u)du, so for X < 0, we obtain F x ( X ) 

F x (x) = f e~ u du = 1 — eT x . 

Jo 


Thus, 


F x (x) 


1 — e x x > 0 

0 otherwise 


0. For X > 0, we have 


c. We can find f(l<X<3) using either the CDF or the PDF. If we use the CDF, we have 

P(1 < X < 3) = F x { 3) - F x { 1) = [1 - e- 3 ] - [l - eT 1 ] = eT 1 - e- 3 . 

Equivalently, we can use the PDF. We have 
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P(1 < X < 3) = J 3 f x (t)dt 

= fi e ^ dt 
= e _1 — e~ 3 . 


Range 

The range of a random variable X is the set of possible values of the random variable. If X is a continuous random variable, we can define the 
range of X as the set of real numbers X for which the PDF is larger than zero, i.e, 

Rx = {x\fx{x) > 0}. 

The set Rx defined here might not exactly show all possible values of X, but the difference is practically unimportant. 

<— previous 
next —> 
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